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In a recent research report released by the Organiza¬ 
tion for Economic Cooperation and Development 
(OECD) that studied education leadership in 22 na¬ 
tions, school leadership improvement was described as 
a worldwide challenge. National school systems 
around the globe are struggling to attract and retain 
school leaders who can effectively respond to the ex¬ 
panding roles and responsibilities of school leadership 
(Pont, Nusche, & Moorman, 2008). In the United 
States, national research reports have focused on a 
need to improve school leadership preparation pro¬ 
grams (Darling-Elammond, LaPointe, Meyerson, & 
Orr, 2007; Levine, 2005), while scholars in the field of 
education leadership have emphasized that prepara¬ 
tion program improvement is essential to overall 
school improvement (Murphy, 1999, 2002; Scribner & 
Bredeson, 1997). Furthermore, education leadership 
researchers have suggested that conventional principal 


preparation programs were not aligned with the 
knowledge, skills, and behaviors required by princi¬ 
pals to function effectively on a day-to-day basis (Eng¬ 
lish, 2006; Fossey & Shoho, 2006; Eless & Kelly, 
2007). In general, preparation programs for school 
administrators have been criticized for being deficient 
in several areas, including recruitment of quality can¬ 
didates, collaboration between university faculty and 
practitioners, and relevant curriculum (Jackson & Kel¬ 
ley, 2002). This impetus for universities to provide 
relevant curriculum and instruction has become in¬ 
creasingly urgent as privatization and alternative prin¬ 
cipal preparation programs compete with traditional 
university programs for student enrollment. Despite 
this call for program relevance, limited studies are 
available that closely examine master’s degree courses 
in school administration, and, in particular, that ana- 
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lyze the content and relevance of master’s-level re¬ 
search courses for school principal candidates. 

The need for a closer examination of the content 
and relevance of the research courses required in mas- 
ter’s-level education leadership programs is evident. In 
general, school leaders around the world are under 
tremendous pressure to meet the demands of increas¬ 
ing academic accountability and high-stakes standard¬ 
ized testing (Pont et ah, 2008). That is, school leaders 
are called upon to apply inquiry skills in leadership 
decision making and, essentially, make what is often 
rhetorically referred to as data-based decisions. 
Moreover, in the United States, school leaders are re¬ 
quired to analyze programs for evidence of scientifi¬ 
cally based research —a term that occurs more than 
100 times in the federal No Child Left Behind Act 
(Hess & Petrilli, 2006). To make decisions dependent 
on research or data, school leaders must develop an 
inquiry-oriented perspective and be trained in how to 
gather, analyze, and use data to facilitate school im¬ 
provement and student achievement, while also con¬ 
sidering the unique school communities they serve 
(Lauer, 2006). Education leaders must develop keen, 
sophisticated research skills that are applicable and 
relevant to the real, daily challenges of leading success¬ 
ful schools. 

Therefore, more empirical studies are needed to 
examine master’s-level research course offerings and 
content in school administration programs, as well as 
to analyze the relevance of the research skills taught 
compared to the actual inquiry competencies required 
by practicing school leaders. The purpose of this study 
was to begin to address this research gap by analyzing 
the course offerings and course content of 72 master’s- 
level research courses in education leadership and 
education administration programs. The sampled pro¬ 
grams were based in the United States, with the excep¬ 
tion of one in Canada and one in Hong Kong. Implica¬ 
tions of study results were examined further within the 
context of professional, policy-dictated standards and 
academic discussions of course content relevance in 
university-based principal preparation programs. 

Related Literature 

The lack of academic literature and empirical studies 
on master’s-level research courses in the field of educa¬ 
tion leadership is puzzling at a time when legislation 


and professional standards require school administra¬ 
tors to make data-based or research-based decisions. 
These requirements are evidenced by standards devel¬ 
oped by the Interstate School Leaders Licensure Con¬ 
sortium (ISLLC). ISLLC was created by members of 
the U.S. National Policy Board for Educational Ad¬ 
ministration (NPBEA), who developed Standards for 
School Leaders in 1996, revised them in 2002 and 
2007, and proposed more revisions in 2009. Specifi¬ 
cally, these standards have consistently included 
statements emphasizing that school leaders should be 
able to use “data-based research strategies” (NPBEA, 
2002, p. 2) and apply “data-based decision making” 
(NPBEA, 2002, p. 10). Combs, Bustamante, and Wil¬ 
son (2007) analyzed the 2002 standards and located 
28 uses of the term research and 15 instances of data. 
In addition to the ISLLC standards, university educa¬ 
tion leadership programs in the United States aspire to 
meet Education Leadership Constituent Council 
(ELCC) standards developed for the National Council 
for Accreditation of Teacher Education (NCATE) by 
the NPBEA and are used as a measure of preparation 
program quality. The ELCC standards also include ref¬ 
erences to data-based decision making and the impor¬ 
tance of inquiry skills for effective school leadership. 

To meet these professional standards as well as 
federal and state government accountability demands 
for student standardized test performance, district and 
school administrators in the United States are consis¬ 
tently called upon to apply research skills in analyzing 
student achievement data and documenting school 
improvement efforts. Clearly, education leadership 
preparation programs might benefit from a closer ex¬ 
amination of this apparent disparity between the grow¬ 
ing demand for school leaders with research skill 
competencies and the overall lack of information on 
university research courses. 

Although many accredited education leadership 
programs in the United States require students pursu¬ 
ing a master’s degree to successfully complete a mini¬ 
mum of one research methods course (Onwuegbuzie 
& Leech, 2005), little attention has been given to the 
content of these courses and the actual relevance of 
research course objectives to the needs of practicing 
school administrators. In general, few studies have 
analyzed how well the content of the research methods 
course prepares school leaders to apply research skills 
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in actual school settings or to be competent consumers 
of research (Huck, 2008). 

Despite this general dearth of research available on 
the content and relevance of master’s research courses 
in education leadership and administration programs, 
some relevant studies were available for review. Most 
of these available studies have consisted of some form 
of descriptive document analysis of research course 
syllabi, surveys exploring faculty and administrator 
perceptions of research courses, or content analysis of 
research textbooks. 

Research Course Offerings 

Hess and Kelly (2007) systematically coded 210 core 
course syllabi from 56 principal preparation programs 
to examine the content of instruction. Findings re¬ 
vealed that just 2% of the courses addressed account¬ 
ability in school management or improvement, and 
less than 5% included instruction on managing school 
improvement using data, technology, or empirical re¬ 
search. In another study, Pohland and Carlson (1993) 
polled faculty at the 52 UCEA member institutions to 
determine the extent of curriculum reform in educa¬ 
tion administration programs. They analyzed 40 insti¬ 
tutions and their list of courses, number of required 
credit hours, and level of study (i.e., masters, doc¬ 
toral). Research courses were ranked eighth in a fre¬ 
quency list of 23 course titles and were offered by 70% 
of the institutions, with a majority of the courses 
(83%) equaling 3 credit hours. 

Pohland and Carlson (1993) categorized the re¬ 
search courses into at least one of five categories in¬ 
cluding general research courses (17.5%), quantitative 
(12.5%), qualitative (30%), research in education ad¬ 
ministration (42.5%), and miscellaneous (12.5%). 
Those in the general category included titles such as 
Introduction to Research and Research Designs. Quan¬ 
titative courses included those relating to statistics. 
The miscellaneous category included examples such as 
Survey Research and Philosophic Inquiry. The authors 
noted some research offerings had changed, and insti¬ 
tutions were shifting from a heavy emphasis on statis¬ 
tics to a greater number of courses focused on qualita¬ 
tive approaches. Based on the review of course titles, 
the authors concluded that although changes were 
occurring in education administration programs, the 
changes were “gradual and incremental rather than 


radical and immediate” (Pohland & Carlson, 1993, p. 
8). Similar studies on research courses and education 
leadership programs were not located even when using 
numerous search terms, databases, and search engines. 

School Leader Perceptions of Research 
Courses 

Exploring school leader perceptions of research 
courses, Combs et al. (2007) examined the NPBEA 
standards and located references to research-related 
skills. In addition, practicing education leaders com¬ 
pleted a questionnaire about their graduate research 
course experience. When asked to recall the content of 
the research course, most administrators remembered 
how to identify a research design, how to cite existing 
literature, and how to compare quantitative and quali¬ 
tative methods. A majority of the comments were cen¬ 
tered on various research designs. Although the ad¬ 
ministrators remembered learning research methods, 
few reported that they applied the skills in their roles 
as school leaders or believed them to be of importance. 
These leaders reported that relevant skills would in¬ 
clude collecting data, analyzing data, and critiquing 
research. Findings also revealed that although school 
administrators believed that consumer research skills 
were important, they did not view themselves as quali¬ 
fied to critique or use research in their jobs. 

In another study that elicited principal perceptions 
of research, Haller and Kleine (2001) discovered that 
few administrators reported using research to impact 
decision making. Some of the reasons cited were (a) a 
lack of knowledge in how to access and interpret re¬ 
search studies, (b) a lack of trust regarding research 
results, (c) a need for immediate answers, and (d) a 
lack of time required to process the abundance of 
available information. Yet, superintendents ranked the 
use of research skills by school principals to be of high 
importance (Lease, 2002). 

Research Textbooks 

Ranis (2003) reviewed textbooks for introductory re¬ 
search courses and collected survey data from educa¬ 
tion administration graduate students. She reported 
that the reviewed textbooks rarely addressed research 
challenges in education and presented few examples of 
applied education research. Ranis (2003) suggested 
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that relevant examples of education research were ap¬ 
plied inconsistently in research textbooks. Two of the 
textbooks reviewed dedicated nearly 40% of their 
chapters to the presentation of research design proce¬ 
dures. Almost one half of the administrators and 
teachers enrolled in a research methods course re¬ 
ported they were not interested in learning more about 
research methods and over 90% were not interested in 
taking additional courses in research methods. Ranis 
concluded that a gap existed between the perceptions 
of university faculty and education leadership students 
regarding the necessary learning objectives of the re¬ 
search course. This gap in perceived needs might have 
influenced the participating educators’ lack of interest 
in taking additional research courses. 

There is a need for further research exploring po¬ 
tential gaps between research course offerings and the 
needs and interests of master’s degree candidates in 
school leadership and administration. To further these 
efforts, this exploratory study aimed to uncover the 
focus and content of research courses in education 
leadership and administrator programs by examining 
master’s research course offerings, titles, and descrip¬ 
tions of University Council of Educational Administra¬ 
tion (UCEA) member institutions. 

Four principal research questions guided this in¬ 
quiry: 

1. Flow many research courses are typically re¬ 
quired in the education leadership master’s 
degree programs at UCEA institutions? 

2. What are the required research courses in the 
education leadership master’s degree programs 
at UCEA institutions? 

3. Flow do UCEA institutions describe their re¬ 
search courses? 

4. To what extent do these research course de¬ 
scriptions reflect the standards for advanced 
programs in education leadership? 

Method 

Sample 

The sample for this study included all institutional 
members listed on the membership list of the Univer¬ 
sity Council for Educational Administration (UCEA) in 
2007 and totaled 78. UCEA is a consortium of re¬ 
search and doctoral granting institutions with the pri¬ 


mary purpose of advancing the preparation and prac¬ 
tice of education leaders (UCEA, 2007). There were 
two primary reasons why UCEA institutions purposely 
were selected for this study. First, the UCEA organiza¬ 
tion is considered a leader in influencing policy and 
program development related to the field of education 
leadership. UCEA’s ongoing involvement in the devel¬ 
opment of the revised education leadership policy 
standards reflects its role as a leading organization. 
Second, in a similar study 15 years ago, researchers 
examined research courses in education leadership 
using UCEA member institutions in their sample (Poh- 
land & Carlson, 1993), providing some basis for trend 
comparison. 

Data Collection 

Research course offerings, titles, and descriptions from 
the identified university programs were gathered by 
searching program websites. Degree plans were located 
to determine the minimum number of required re¬ 
search coursework for the master’s degree. Specifically, 
we searched a variety of locations including the educa¬ 
tion leadership department’s website, the college’s 
website, the university catalog, the graduate school 
catalog, and the course registration system to locate 
the requirements for a master’s degree in education 
leadership. Course titles, descriptions, and credit 
hours for research or research-related courses (i.e., 
statistics) were copied and pasted into a spreadsheet to 
organize data for analysis. Of the 78 institutions in the 
sample, two were eliminated because of inoperable 
websites and four were eliminated because the institu¬ 
tions did not display course requirements on their 
websites, leaving 72 institutions. 

Data Analysis 

Classical content analysis was determined to be the 
most appropriate approach to analyzing the data on 
research course offerings because the technique al¬ 
lowed for inferences to be made by objectively and 
systematically identifying specified characteristics of 
text (Berelson, 1952; Krippendorf, 2004). Classic con¬ 
tent analysis essentially involves a systematic analysis 
of text to extract patterns and symbols of meaning to 
allow researchers to infer or predict phenomena that 
cannot be observed easily (Krippendorf, 2004). Krip- 
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pendorfs questions and coding procedures provided 
an applicable general framework for analyzing the con¬ 
tent of research course titles and course descriptions. 
Additionally, the methods of constant comparison 
(Glaser & Strauss, 1967) and horizonalization 
(Moustakas, 1994) were utilized to enhance credibility 
and inter-coder agreement. To do this, we read and re¬ 
read each research course description and then unit¬ 
ized them. 

Data were analyzed in several phases. First, the 
number of actual courses required by each master’s 
program in education leadership was determined. Sec¬ 
ond, course titles were analyzed for word frequencies 
and then categorized as they related to education- 
specific or non-discipline specific research courses. 
Third, the keywords were collapsed into similar se¬ 
mantic categories (e.g., research methods, research 
designs) based upon the words contained in the course 
title. The categories identified included generic re¬ 
search courses (i.e., Research Methods, Research De¬ 
sign) course titles using the word education , and titles 
containing words pertaining to school leaders or edu¬ 
cation administrators. Next, course titles were catego¬ 
rized by research approaches suggested in the title 
such as quantitative research, qualitative research, sta¬ 
tistics, program evaluation, and action research. Titles 
suggesting school improvement, data analysis, or in¬ 
quiry were also noted. In all, 11 categories were cre¬ 
ated and each title was coded a “1” if the title con¬ 
tained the theme and a “0” if it did not. Categories 
were not exclusive and some titles represented several 
themes. Finally, categories were summed and de¬ 
scribed using frequency counts and percentages. 

A similarly iterative process was followed for the 
analysis of course descriptions. Specifically, key words 
and phrases for each description were highlighted. 
This served as a basis for extracting a list of nonrepeti- 
tive, nonoverlapping significant statements (i.e., hori- 
zonalization of data; Moustakas, 1994), with each 
statement being given equal weight. Units were elimi¬ 
nated that contained the same or similar statements or 
key words so each analyzed unit corresponded to a 
unique response. Meanings then were formulated by 
extracting the meaning of each significant statement. 
Next, these significant statements were compared to 
previous codes so that similar clusters were labeled 
with the same code. After all the responses had been 
coded, the codes were grouped by similarity, and a 


theme was identified and outlined based on each 
grouping. That is, the aggregate formulated meanings 
were organized into emergent themes and subthemes, 
with each theme and subtheme consisting of units that 
were deemed similar in content. 

Using this process of analysis for inter-coder reli¬ 
ability, we grouped related terms into 12 initial classifi¬ 
cations which were (a) basic research methods, (b) 
basic concepts and terms, (c) data collection, (d) edu¬ 
cation research, (e) education leadership, (0 research 
process, (g) writing, (h) independent projects, (i) re¬ 
search tools, (j) consumption of research, (k) school 
improvement, and (1) real-world applications. The 
course description data were then set aside and re¬ 
examined after a 2-month period. 

Then, we determined that the initially identified 
categories could be further collapsed into six themes: 
(a) basic research concepts (i.e., methods, terms, data 
collection); (b) tools for research (i.e., library searches, 
statistics, computer programs, and writing); (c) inde¬ 
pendent research projects; (d) consumption of re¬ 
search; (e) education research (e.g., reference to real 
world situations in an education context); and (0 edu¬ 
cation leadership (i.e., administration, program evalua¬ 
tion, and school improvement). The basic research 
concepts theme included all references to terms and 
processes that could be applied in social and behav¬ 
ioral sciences, regardless of the specific discipline. The 
tools theme was created after consulting Leedy and 
Ormrod’s (2005) description of research tools that are 
used by researchers to make meaning of collected data 
and are not discipline-specific. Leedy and Ormrod in¬ 
cluded library resources, computer applications, statis¬ 
tics, and writing in their definition of research tools. 
Some universities solely described the development of 
an independent research project as the course re¬ 
quirement and others included a research project in 
their overall course descriptions. For this reason, in¬ 
dependent research project was identified as a theme 
and coded accordingly. Course descriptions that re¬ 
ferred to preparing students to be consumers of re¬ 
search were coded as the theme of consumption. The 
theme education research included all direct references 
to education and action research in schools or class¬ 
rooms. Finally, education leadership and administra¬ 
tion included course descriptions that included these 
terms in addition to school improvement or evaluation 
as education leaders normally take on these functions. 
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For each of the course descriptions, a “0” (no Table 1 
mention of terms related to theme category) or “1” 

(reference to a theme-related term) was given for 
each of the six thematic categories. Coding was 
not mutually exclusive as course descriptions 
could receive a “1” in various categories. 

Frequencies and percentages for each thematic 
category were then determined. 

Additionally an analysis of standards for 
education leadership programs (NPBEA, 2002) (n = 72) 
described in a previous study (Combs et ah, 2007) 
was reviewed and compared to revised standards, 
Education leadership Policy Standards: ISLLC 2008 
(NPBEA, 2007), and course descriptions. We wanted 
to examine the extent to which the revised standards 
for education leadership programs contained language 
related to use of data, inquiry, and school improve¬ 
ment as compared to the previous standards (NPBEA, 

2002). Key phrases were identified in the standards 
that related to the use of data, research, or inquiry. 

Then, key phrases were compared to determine simi¬ 
larities and differences in language. 

Findings 

Research Course Requirements 

The required credit hours for research courses in a 
master’s degree ranged from 0 to 10 hours as shown in 
Table 1. Of the 72 institutions, 16 (22.2%) did not 
require a research course for students pursuing a mas¬ 
ter’s degree in education leadership. Of the 56 institu¬ 
tions that included a research course in the core cur¬ 
riculum, 42 (58.3%) called for 3 hours of research 
coursework and 8 (11.1%) for 6 credit hours. The re¬ 
maining five institutions requested that education 
leadership students take 4, 8, 9, or 10 credit hours in 
research. One institution did not use a credit hour sys¬ 
tem but did include one research course as part of its 


Research Course Requirements in Education Leadership 
Masters Degree Programs at UCEA Institutions 2007 

Research Course Requirements 

n 

% 

No hours required 

16 

22.2% 

3 credit hours required 

42 

58.3% 

4 credit hours required 

3 

4.2% 

6 credit hours required 

8 

11.1% 

8, 9, or 10 credit hours 

3 

4.2% 


Table 2 

Content Analysis of Course Titles of Required Research Courses in Education Leader¬ 
ship Master’s Degree Programs at UCEA Institutions 2007 


Theme 


Example Course Titles 


Generic 23 31.1% 

Education 41 55.4% 

Education leadership 10 13.5% 


C n = 74) 


course requirements. The university program that 
asked students to take 10 hours of coursework had a 
master’s degree program requiring 51 hours. There¬ 
fore, these findings suggest that most UCEA institu¬ 
tions require one 3-hour research course in the mas¬ 
ter’s degree program for education leaders. 

Course Titles 

For the 56 institutions requiring a research course, 74 
research course titles were analyzed and categorized as 
shown in Table 2. Of the 74 course titles, 23 (31.1%) 
were generic research courses, having titles such as 
Research Methods, Foundations in Research, and Re¬ 
search Design and Methodology. The generic titles 
were listed with a variety of prefixes, indicating that 
such courses were taught by faculty in other depart¬ 
ments outside of education leadership (e.g., education 
psychology, math, statistics). Then, course titles were 
analyzed for their mention of education or education 
leadership. Of the 74 titles, 41 (55.4%) specifically 
mentioned education in the course title, 33 (44.6%) 
did not. Some examples of courses specific to educa¬ 
tion included Research and Educational Practice and 
Research Design in Education. Of the 41 research 
courses specific to education, 10 (13.5%) of the titles 
contained language specific to education leaders such 
as Quantitative Methods in Educational Leadership, 

__ Research in Educational 

Administration and 
Policy, and Research for 
Effective School 

Leaders. 

The course titles 
were analyzed for their 
mention of statistics, 
quantitative research, 


Research Methods, Foundations in Research 
Research Design in Education 
Research for Effective School Leaders 
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qualitative research, program evaluation, and action 
research. Of the 56 institutions requiring a research 
course, nine required a course in statistics. Interest¬ 
ingly, four of the nine institutions having a statistics 
course also expected students to take one other re¬ 
search course, while five of the institutions listed the 
statistics course as its only research course. Of the 56 
institutions, six had required research courses related 
to quantitative methods, five specified qualitative 
methods, and six had program evaluation in the title. 
Four institutions, all of which required at least two 
research courses, offered an action research course. 
Course titles were also analyzed for less common 
names. Of the 56 institutions, three offered a course 
containing inquiry in the title, two mentioned school 
improvement , and three specified data use or data 
analysis. In summary, 55.4% of the course titles spe¬ 
cifically mentioned education and 31.1% had generic 
research methods titles. Fewer courses (13.5%) were 
specific to education leaders. 

Course Descriptions 

The 74 course descriptions among the 58 institutions 
were analyzed and coded using the following six 
themes: (a) basic research concepts, (b) tools for re¬ 


search, (c) independent projects, (d) consumption of 
research, (e) education research, and (0 research for 
education leaders and school improvement. The cate¬ 
gories were not exclusive, and some course descrip¬ 
tions were coded in multiple categories. 

As shown in Table 3, findings revealed that 37 
(50.0%) research course descriptions focused on basic 
research concepts, 30 (40.5%) referred to education or 
schools in their descriptions of the research course, 
and 23 (31.1%) described the use of tools in the 
course. Moreover, 16 (21.6%) of the research course 
descriptions actually contained the term education 
leadership or school improvement, and both con¬ 
sumption of research (8.1%) and independent research 
projects (8.1%) were mentioned six times in research 
course descriptions. 

Two of the universities reviewed were located out¬ 
side the United States. Their course descriptions con¬ 
tained terms such as education research and education 
leadership. These international universities appeared 
to be negative cases when compared to the other insti¬ 
tutions due the thoroughness of their course descrip¬ 
tions and their specific reference to the development of 
research skills for education leadership and school im¬ 
provement. These negative cases were retained in the 
analysis. 


Table 3 

Content Analysis of Research Course Descriptions 


Theme Example Statements from Description 

Frequency 


Basic Research Concepts 

“development of basic skills in understanding, planning, and 
executing a research study” 

“issues in research design and methodology” 

50.0% 

Educational Research 

“major modes of inquiry in contemporary educational research” 

40.5% 

Tools for Research 

“statistics as a tool in education” 

“applying the tools of research to address issues that face school 
leaders” 

31.1% 

Research for Education 
Leadership and/or School 
Improvement 

“learn how to use data to drive instruction” 

“improvement of educational programs” 

21.6% 

Consumption of Research 

“skills necessary for critical consumption of quantitative re¬ 
search” 

“become intelligent consumers of research” 

8.1% 

Independent Research 

Projects 

“complete a research project or field study” 

“complete a paper including an action research plan” 

8.1% 


Note. Categories are not mutually exclusive 
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Standards for Education Leadership Pro¬ 
grams 

The program standards for education leadership 
(NPBEA, 2007) were analyzed, and several statements 
were found that specified some research-related expec¬ 
tations of education leaders. Specifically, six phrases 
were found in the 2007 standards. Leaders were ex¬ 
pected to “monitor and evaluate” programs and prac¬ 
tices (NPBEA, 2007, SI 3, 5, 7); “promote continuous 
and sustainable improvement” (H 3); “collect and use 
data to identify goals, assess organizational effective¬ 
ness” fll 3); and “collect and analyze data ... pertinent 
to the education environment” (H 9). The key words 
we as the researchers selected from these statements 
were monitor, evaluate, collect, and analyze, and the 
74 course descriptions were reviewed to identify the 
use of these words or their derivatives. 

As shown in Table 4, classical content analysis re¬ 
vealed that of the 74 research methods descriptions, 
19 (25.6%) mentioned data analysis, 12 (16.2%) con¬ 
tained the concept of evaluation, 12 (16.2%) men¬ 
tioned the collection or gathering of data, and 3 
(4.1%) referenced monitoring of programs, practices, 
or both. After analyzing all 74 course descriptions, 30 
(40.1%) mentioned at least one of the key words, 
which were monitor, evaluate, collect, and analyze. 
Therefore, less than one half of the research methods 
courses contained some language related to inquiry 
skills that appear in the NPBEA standards for educa¬ 
tion leadership preparation programs. 

Discussion 

This exploratory study was designed in response to 
U.S. policies and professional standards requiring 
school leaders to be highly qualified in applying re¬ 
search skills in ways that lead to student achievement 
and overall school improvement. In this study, classical 
content analysis was ap¬ 
plied to review research 
course offerings, titles, 
and course descriptions 
required in master’s pro¬ 
grams in education lead¬ 
ership or school admini¬ 
stration. As a starting 
place for evaluating the 


quality of education leadership programs, scholars 
have used content analysis to examine written program 
requirements, course descriptions, and syllabi (Hack- 
mann & Wanat, 2007; Eless & Kelly, 2007). 

Likewise, as a first step in exploring research offer¬ 
ings and research course content in master’s programs 
in education leadership, we employed a similar ap¬ 
proach. Implications from this study are relevant to 
several areas that impact education leadership pro¬ 
grams. These areas include policymaking and profes¬ 
sional standards for accreditation, program curriculum 
offerings, and relevance of research course objectives 
and content as revealed by the language used in course 
descriptions. 

Both U.S. government accountability policies and 
professional standards in the field of education leader¬ 
ship require that school leaders use research data in 
making decisions that influence student achievement 
and overall school improvement. The focus on ac¬ 
countability in the United States became more strin¬ 
gent in 1965 with the enactment of the Elementary 
and Secondary Education Act, which was reauthorized 
by President George Bush as the No Child Left Behind 
Act of 2001. President Barack Obama’s administration 
continues to support the act as accountability and re¬ 
search-based instruction continue to play a large role 
in Obama’s state fund competition as exemplified by 
the Race to the Top program. 

In addition to government accountability policies, 
the professional NPBEA standards call for the prepara¬ 
tion and development of education leaders who are 
inquiry-oriented and capable of making research-based 
decisions. The professional standards stipulated by the 
ELCC and the NCATE form a basis for judging 
whether U.S. colleges of education and master’s degree 
programs in education leadership receive national ac¬ 
creditation. Consequently, the need for policy makers 
and program coordinators to examine research course 
requirements and offerings in master’s degree pro- 


Table 4 

Classical Content Analysis ofNCPEA Standards in Research Course Descriptions 

Code 

Examples 

Frequency 

Analyze data 

“data analysis” 

25.6% 

Evaluate programs & practices 

“planning and program evaluation” 

16.2% 

Collect/Gather Data 

“data gathering” “data collection” 

16.2% 

Monitor programs & practices 

“data relevant to monitoring” 

4.1% 

Note. Categories are not mutually exclusive 
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grams in education leadership increasingly is evident. 
Furthermore, education leadership programs might 
benefit from national, state, and university policies and 
professional standards that explicate more clearly the 
research knowledge and skills most needed for practic¬ 
ing school leaders to positively impact school im¬ 
provement. 

Results from this research were also relevant to 
master’s program curriculum in education leadership. 
We discovered that the majority of university programs 
sampled in this study required at least one research 
course as part of the core curriculum. Because of the 
limited number of courses offered within a master’s 
program and the required number of courses needed 
to meet principal certification standards, one research 
course typically is all that can be offered. Additionally, 
some program coordinators design their education 
leadership master’s courses to integrate research skills 
throughout a course sequence by requiring various 
field projects that include skills related to data analy¬ 
sis, data collection, and program evaluation. However, 
in this study, we did not examine other course descrip¬ 
tions and this type of coordination among courses was 
not explicated in the research course descriptions. Fol¬ 
lowing, it can be difficult to determine to what extent 
research skills are integrated throughout other courses 
in an education leadership curriculum. Overall, based 
on this study and previous research (Combs et ah, 
2007; Ranis, 2003), we propose that the number of 
research courses offered is of lesser concern than the 
relevance of the research knowledge and skills to the 
work of practicing school leaders. 

Indeed, one research course offering might be suf¬ 
ficient if the content is focused on relevant inquiry 
skill development and the language used in course 
descriptions reflects a specific focus on education lead¬ 
ership. However, results from this study revealed great 
inconsistencies in the language used in research course 
descriptions. Few course descriptions contained lan¬ 
guage specific to the responsibilities of today’s school 
leaders. In fact, only 16 of the 74 education leadership 
programs included in our sample used the terms 
school leadership or school improvement in their re¬ 
search course descriptions. Furthermore, many of the 
research course descriptions were so generic that they 
could be applied to any social science discipline. Addi¬ 
tionally, many of the required research courses were 
housed in departments other than the college of edu¬ 


cation, such as math departments, or taught by faculty 
from other disciplines not related to education. Both 
generic course descriptions and research courses of¬ 
fered outside the education leadership program imply 
that some program coordinators and professors believe 
that one generic course in traditional research methods 
adequately equips candidates for the kind of research 
competencies needed to lead effective schools. 

Promising was the fact that just over one half of 
the research course titles reviewed did include the 
term education. Use of the term education in the title 
indicated that research skills might more likely be ex¬ 
plored within an education context. However, research 
course titles in education leadership should not only 
refer to education, but also demonstrate a clear con¬ 
nection to education leadership. Even when course 
titles and descriptions in this study did refer to the 
context of education, it was unclear how much em¬ 
phasis actually was placed on research competencies 
required of effective leaders. These competencies 
would likely include the ability to critically analyze 
existing data, competently consume research, assess 
organizational cultures and climates for diverse con¬ 
stituencies, develop survey instruments, evaluate pro¬ 
grams, analyze existing achievement data, and deter¬ 
mine teachers’ professional development needs. 

Research courses cannot be a panacea for the bet¬ 
terment and relevance of master’s programs in educa¬ 
tion leadership. In addition, program coordinators 
rarely have the luxury of adding additional courses to 
an already full curriculum. The implications of this 
study relate to what can be inferred from course titles 
and descriptions. Because university professors fre¬ 
quently rely on course titles and descriptions to guide 
the planning of course content, activities, and assess¬ 
ments, the findings from this study call attention to the 
need to use inquiry-oriented language that reflects the 
needs and required skills of education leaders. 

In particular, course descriptions drive the plan¬ 
ning of adjunct professors, lecturers, or contingency 
faculty who might have little direct contact with the 
university and who typically rely on course descrip¬ 
tions, textbooks, and previous course syllabi to plan 
their classes. Inadequate, misleading, or generic course 
descriptions that do not sufficiently address the re¬ 
search skills required of education leaders could influ¬ 
ence professors’ decisions about course content and 
the need to provide relevant application for school 
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leaders. Consequently, education leadership depart¬ 
ments should examine what is and is not included in 
the course descriptions and consider how inquiry- 
related knowledge is situated in school contexts. 

Implications for future research include a need to 
replicate this study with a larger sample of education 
leadership programs. Programs offering alternative 
routes to leadership certification should be examined 
to identify the curriculum prescribed for leaders re¬ 
lated to data analysis and applied research skills. In 
addition, researchers could describe what is actually 
being taught in research courses through observations 
and professor self-reports. Also, there is a need to ex¬ 
amine how the research skills applied by education 
leaders in their daily work in schools compare to fac¬ 
ulty members’ perceptions of what is important to 
teach. Comparing these perspectives could provide 
further insight into how research courses could be 
more relevant for practicing school leaders. Such 
knowledge could be used to address the gap between 
university faculty and education leaders’ perceptions of 
the necessary research skills (Ranis, 2003). 

Limitations to this study include an acknow¬ 
ledgement that course titles and descriptions might 
not reveal what is actually taught in a research class or 
how relevant a professor might make course material 
to the practice of education leadership. However, the 
focus of this research was at the organizational level 
(i.e., master’s degree requirements for education lead¬ 
ership candidates); thus examining course descriptions 
was deemed to be more appropriate than examining 
individual professors’ course syllabi. Further, the 
method of examining documents (i.e., descriptions, 
textbooks, syllabi) has been applied by previous re¬ 
searchers (e.g., Hess & Kelly, 2007; Onwuegbuzie & 
Leech, 2005; Ranis, 2003) when analyzing content. 
Another limitation involves the use of websites. Infor¬ 
mation used in this study was gathered from university 
websites; however, websites do not always contain up¬ 
dated information about program requirements and 
course descriptions. Finally, the research courses pro¬ 
vided by institutions in this study might not represent 
those at other education leadership preparation pro¬ 
grams. Although these limitations have been noted, 
there were few studies where researchers have ana¬ 
lyzed research courses for school leader candidates. 
Thus, this study represents an attempt to engage uni¬ 


versity faculty and school leaders in a discussion about 
the relevance of research courses. 

In an era when education policies dictate that 
school leaders use data to monitor and to improve the 
learning of all students, graduate programs in educa¬ 
tion leadership must ensure that required research 
courses truly provide leaders with the necessary re¬ 
search tools to perform their jobs. Understanding re¬ 
search course offerings and requirements is a critical 
step in promoting the relevant instruction and quality 
preparation of future school leaders. 
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